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Abstract 

We show that the non-additivity relation of the Tsallis entropies in 
nonextensive statistical mechanics has a simple physical interpretation 
for systems with fluctuating temperature or fluctuating energy dissi- 
pation rate. We also show that there is a distinguished dependence 
of the entropic index q on the spatial scale that makes the Tsallis 
entropies quasi-additive. Quasi-additivity implies that q is a strictly 
monotonously decreasing function of the spatial scale r, as indeed ob- 
served in various experiments. 
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The formalism of nonextensive statistical mechanics has been developed 
over the past 13 years as a powerful and beautiful generalization of ordinary 
statistical mechanics 0-0]. It is based on the extremization of the Tsallis 
entropies 

^ = ^r(i -Erf) d) 

subject to suitable constraints. Here the Pi are the probabilities of the phys- 
ical microstates, and q is the entropic index. The Tsallis entropies reduce to 
the Boltzmann Gibbs (or Shannon) entropy S% = — 2iP«l°SPi for q — > 1, 
hence ordinary statistical mechanics is contained as a special case in the gen- 
eralized formalism. There is growing experimental evidence that q 7^ 1 yields 
a correct decription of many complex physical phenomena, including hydro- 
dynamic turbulence ||— [§], scattering processes in particle physics || ITofl , 
and self-gravitating systems in astrophysics [11, P3| , to name just a few. A 
complete list of references can be found in Q. 

The Tsallis entropies are non-extensive. Given two independent subsys- 
tems I and II with probabilities p\ and pj 1 , respectively, the entropy of the 
composed system I+II (with probabilities pfj' 11 = pip 1 /) satisfies 

s i + ii = s i + S n _ {q _ 1)s i s ii (2) 

Hence there is additivity for q = 1 only. This property has occasionally 
lead to unjustified prejudices, using arguments of the type 'entropy must be 
extensive'. In the following, however, we will see that the non-additivity 
property is not at all a 'bad' property, but rather a natural and physically 
consistent property for those types of systems where nonextensive statistical 
mechanics is expected to work. 

Broadly speaking, the formalism with q 7^ 1 has so far been observed to be 
relevant for two different classes of systems. One class is systems with long- 
range interactions (e.g. [ITT1 [13, |13f), the other one is systems with fluctuations 



of temperature or of energy dissipation (e.g. [§, |9], [10], |14jl). For the first class 
of systems, the concept of independent subsystems does not make any sense, 
since all subsystems are interacting. Hence there is no contradiction with 
the non-additivity of entropy for independent subsystems since independent 
subsystems do no exist for these systems (by definition of the long-range 
interaction). 

Let us thus concentrate on the other class, systems with fluctuations. 
Consider a system of ordinary statistical mechanics with Hamiltonian H. 
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Tsallis statistics with q > 1 can arise from this ordinary Hamiltonian if one 
assumes that the temperature is locally fluctuating. From the integral 
representation of the gamma function one can easily derive the formula [7], [L4| 

/>oo 

(1 + (q - 1)(3 H)-^ = / e-P H f(P)d(3, (3) 

Jo 
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where 



is the probability density of the x 2 distribution. The above formula is valid 
for arbitrary Hamiltonians H und thus of great significance. The left-hand 
side of eq. (§) is just the generalized Boltzmann factor emerging out of nonex- 
tensive statistical mechanics. It can directly be obtained by extremizing S q . 
The right-hand side is a weighted average over Boltzmann factors of ordi- 
nary statistical mechanics. In other words, if we consider a nonequilibrim 
system (formally described by a fluctuating (3), then the generalized distri- 
bution functions of nonextensive statistical mechanics are a consequence of 
integrating over all possible fluctuating inverse temperatures (3, provided (3 
is x 2 distributed. 

The x 2 distribution is a universal distribution that occurs in many very 
common circumstances (see any statistics handbook on this, e.g. ]15[). For 
example, it arises if (3 is the sum of squares of n Gaussian random variables, 
with n = 2/(q—l). Hence one expects Tsallis statistics to be relevant in many 
applications. For fully developed turbulent hydrodynamic flows, where Tsal- 
lis statistics has been observed to work very well ||, is not the physical 
temperature of the flow but a formal temperature defined by the fluctuating 
energy dissipation rate times a time scale of the order of the Kolmogorov 
time [^]. In the application to scattering processes in collider experiments 
H [TIJ, (3~ l is a fluctuating inverse temperature near the Hagedorn phase 



transition. 

The constant /3q in eq. (|l) is the average of the fluctuating /3, 



E{(3) := / (3f{(3)d(3 = fa (5) 
Jo 

(E denotes the expectation with respect to f((3)). The deviation of q from 1 
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can be related to the relative variance of (3. One has 

9 - 1 = ^(^ • (6) 

We can now give physical meaning to eq. (0) for q > 1. Consider two 
independent subsystems I and II that are composed into one system I+II. 
In system I (as well as II) the fluctuations of temperature T are expected to 
be larger than in I+II, due to the smaller size of I (or II) as compared to 
I+II. Remember that generally entropy is a measure of missing information 
on the system |Tj|. The entropy Sg + S* 1 is larger than Sg +n , since in the 



single systems the probability distribultion of T is broader, thus our missing 
information on these systems is larger. Hence there must be a negative 
correction term to Sg + Sg 1 in eq. (|2|). It is physically plausible that this 
correction term is proportional a) to the relative strength of temperature 
fluctuations as given by q — 1 and b) to the entropies S* and Sg 1 in the single 
systems. Hence we end up with eq. (0). 

For most physical applications the fluctuations of (3 (or the relevant value 
of q) are observed to be dependent on the spatial scale r. For example, in the 
turbulence application detailed measurements of q(r) have been presented in 
||. q turns out to be a strictly monotonously decreasing function of the 
distance r on which the velocity differences are measured. Similarly, for the 
application to e + e _ annihilation [0, q{r) turns out to be again a strictly 
monotonously descreasing function of the scale r, which in this case is given 
by r ~ h/E cm , where E cm is the center of mass energy of the beam. Let us 
now present a theoretical argument why physical systems may like to choose 
a scale-dependent monotonously decreasing q. 

The observation is that it is possible to make the Tsallis entropies quasi- 
additive by choosing different entropic indices at different scales. I.e., given 
a certain q for two small independent subsystems I and II we may choose 
another q' for the larger, composed system I+II such that 

Si + = fl}+". (7) 

We may call this property quasi- additivity. For practical applications, q is 
often close to 1, so that a perturbative expansion in q — 1 makes sense. One 
obtains 

£rf = E^ e(9 ~ 1)losPi 
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= l + (g-l)^^log ft + -(g-l) 2 ^p i (logpi) 2 + ..., (8) 

where the dots denote higher-order terms in q — 1. This yields for the sum 
of entropies of the two identical subsystems 

s;+s? = 2si = -^(i-E^) 

i 

= -2^^1ogpi - (g- l)^pi(logpi) 2 - ... (9) 
On the other hand, by squaring eq. (||) one obtains 

(5>f) 2 = l + 2(g-l)^ ft log ft 

+ (g - l) 2 (^ Pl logp,) 2 + {q- l) 2 £>(log Pi ) 2 + . . . (10) 
and hence the entropy of the composed system satisfies 



qi+n 



Ms*) 
M~ { w) 



-2^2pi\ogpi - (q' - 1) (C^pdogpi) 2 + ^Pi(logpi) 2 ) 
+ ... (11) 



Quasi-additivity thus implies a relation between q' and q, namely 

Q' ~ 1 = ^p.(log^) 2 

q ~ 1 ]L>i(logpi) 2 + (J] ^ log ft) 2 ' 

which can be written in the simple form 



;i2) 



(B l ) 2 Y 1 , s 

! + 7^ • 13) 



g-i V (sf) 

Here i?j := logpj is the so-called 'bit number' The negative expectation 
— (Bi) of the bit number is just the ordinary Boltzmann-Gibbs (or Shannon) 
entropy. We thus see that quasi- additive behaviour necessarily implies a 



4 



change of q with system size. For q close to 1, this change is determined 
by eq. (|13"D, which involves the average and variance of the bit number, i.e. 
quantities related to fluctuations of the Shannon entropy. It is now clear 
from eq. ([13]) that q' — 1 (corresponding to the larger system) is smaller than 
q — 1 (corresponding to the smaller system) for arbitrary probabilities pi. In 
other words, q(r) is a strictly monotonously decreasing function of the scale 
r, just as observed in the experiments. 
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